Is there a mcgurk effect for tongue reading?
نویسنده
چکیده
Previous studies on tongue reading, i.e., speech perception of degraded audio supported by animations of tongue movements have indicated that the support is weak initially and that subjects need training to learn to interpret the movements. This paper investigates if the learning is of the animation templates as such or if subjects learn to retrieve articulatory knowledge that they already have. Matching and conflicting animations of tongue movements were presented randomly together with the auditory speech signal at three different levels of noise in a consonant identification test. The average recognition rate over the three noise levels was significantly higher for the matched audiovisual condition than for the conflicting and the auditory only. Audiovisual integration effects were also found for conflicting stimuli. However, the visual modality is given much less weight in the perception than for a normal face view, and intersubject differences in the use of visual information are large.
منابع مشابه
The Mcgurk effect in dyslexic and normal-reading children: an experimental study
The McGurk effect was investigated in a group of ten-yearold dyslexic children and in two control groups of normal readers. Audio and audiovisual stimuli were presented in silence or with a masking noise. The results indicated no significant differences between the three groups for the auditory stimuli. For the audiovisual stimuli, the dyslexic group showed fewer illusory percepts than the grou...
متن کاملDevelopmental factor in auditory-visual speech perception - the Mcgurk effect in Mandarin-Chinese and English speakers
This study investigated the developmental factor in the use of visual information in auditory-visual speech perception in Mandarin-Chinese and English native speakers. Adults and 8to 9-year-old children from two language backgrounds (Mandarin-Chinese and English) were presented stimuli consisting of /ba/, /da/, /ga/ and were asked to make syllable identifications in auditory-only, visual-only a...
متن کاملBinding and unbinding the Mcgurk effect in audiovisual speech fusion: follow-up experiments on a new paradigm
The McGurk effect demonstrates the existence of a fusion process in audiovisual speech perception: the combination of the sound "ba" with the face of a speaker who pronounces "ga" is frequently perceived as "da". We assume that in the upstream of this phonetic fusion process, there is a “binding” process, which controls the combination of image and sound, and can block or reduce it in the case ...
متن کاملWhat is the McGurk effect?
McGurk and MacDonald (1976) reported a powerful multisensory illusion occurring with audiovisual speech. They recorded a voice articulating a consonant and dubbed it with a face articulating another consonant. Even though the acoustic speech signal was well recognized alone, it was heard as another consonant after dubbing with incongruent visual speech. The illusion has been termed the McGurk e...
متن کاملFace or Voice? Determinant of Compellingness
This study examined sources of talker differences in the McGurk effect, by questioning which of auditory speech or visual speech is more determining the size of the McGurk effect. Cross-talker dubbing was done between faces and voices of utterances (/ba/ and /ga/) pronounced by two talkers: one compelling talker (CT) to the McGurk effect, and one less compelling talker (LT), as measured in our ...
متن کامل